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Abstract. It is argued that systems whose elements are renewed according to an 
extremal criterion can generally be expected to exhibit long-term memory. This is 
verified for the minimal extremally driven model, which is first defined and then 
solved for all system sizes N > 2 and times t > 0, yielding exact expressions 

C^ , for the persistence R{t) = [1 + t/{N — 1)]^^ and the two-time correlation function 

S ; C{t„+t,t^) = {l-l/N){N+t^)/{N+t^+t-l). The existence of long-term memory is 

' ■ inferred from the scaling of C(tw +t, iw) ~ /(V^w), denoting aging. Finally, we suggest 

pH I ways of investigating the robustness of this mechanism when competing processes are 

Q ' present 
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In recent years there has considerable progress in identifying the mechanisms 
responsible for long-term memory in glasses and other slowly relaxing systems, with 
processes such as domain coarsening and diffusion over random free energy landscapes 
now well established (see e.g. [|1], ^ |^ and references therein). However, long-term 
memory has also been observed in a class of systems, namely the so-called extremally 
driven models, for which there is no obvious underlying mechanism. This is not a 
satisfactory state of affairs, as these models have applications covering a broad range of 
physically important situations, in particular to athermal and low temperature systems 
such granular media, flux creep etc. One may reasonably ask how we can ever expect to 
understand the real systems if even their simplified models behave in a way that cannot 
be properly explained. 

The defining characteristic of extremally driven models is that they are updated by 
identifying an 'active' region of the system, and renewing this region whilst leaving the 
remainder unaltered. The active subsystem is chosen according to some kind of extremal 
criterion; often it will be centred on the location of the minimum (or, equivalently, the 
maximum) of some spatially varying scalar variable, but other possibilities have been 
considered. Models that belong to this class include invasion percolation 0|, the Bak- 
Sneppen model and the granular shear model of Torok et al. 0, amongst others 0]. 
Recently, both the Bak-Sneppen and granular shear models have been found to exhibit 
aging p, p, ^, which indicates the existence of some form of long-term memory. The 
Bak-Sneppen model, along with many other extremally driven models, is critical in the 
sense that it has been placed by construction at a critical point {i.e. a continuous phase 
transition) of a broader phase diagram. By contrast, the granular shear model of Torok 
et al. is not critical, so if the same mechanism is responsible for both cases of aging, it 
cannot be due to any of the properties of the critical state. 

In this Letter we demonstrate that extremal driving hy itself is enough generate 
long-term memory, and claim that this is the true cause of the aging observed in the 
Bak-Sneppen and granular shear models. We further speculate that this mechanism is 
somewhat robust and that many other extremally driven models will also age; to the 
best of our knowledge, such behaviour has never been looked for in the other models 
in this class. The central part of this work is the solution of the simplest extremally 
driven model, which is shown to age in a similar manner to that observed in f^, §]. 
Since the only mechanism in the model is the extremal driving, it is reasonable to infer 
that this is the cause of the long-term memory. A secondary aspect of this work is that 
the model can be exactly solved for all system sizes and times. This allows the finite 
size effects and transient behaviour to be explicitly calculated, which is rarely possible 
in systems exhibiting slow relaxation. It is also hoped that this work will help to extend 
the relationship between extremal statistics and glassy relaxation that was originally 



stressed by Bouchaud and Mezard [10 



The model to be studied here is defined as follows. The system consists of A^ 
elements which are each assigned a single scalar variable Xj , i = 1 . . . N, drawn from 
the fixed probability distribution function p{x). For every time step t — > t + 1, the 
element with the smallest Xi in the system is selected and renewed by assigning it a 
new value of Xi , which is drawn from p{x) as before. Non- degeneracy is assumed, 
i.e. no two Xi can take the same value, which is valid as long as A^ is finite and p{x) 
contains no delta-function peaks. Selecting the maximum rather than the minimum 
would result in entirely equivalent behaviour and we henceforth restrict our attention 
to the minimum case only. This minimal model can be viewed as a one-dimensional 
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version of the granular shear model [0, or equally as the Bak-Sneppen model without 
interactions 0. 

Before solving the model, it is instructive to describe the emergence of long-term 
memory in qualitative terms. For this system, as for any system subjected to extremal 
driving, the typical values of Xi increase monotonically in time. This means that any 
recently renewed element is likely to have a smaller Xi than the bulk, and hence a 
shorter than average lifespan until it is again renewed. Correspondingly, elements that 
have not been renewed for some time will have a longer than average life expectancy. 
This separation between the shortest and the longest lived elements will become more 
pronounced as the system evolves and the average Xj in the bulk increases. Thus one 
might reasonably expect a broad distribution of relaxation times, and the possibility of 
long-term memory. 

To put this picture into a more precise framework, let Pt{S) be the probability to 
find the system in a state S after t updates, where S = {xi,X2 . . .xjy} [more formally 
the probability is -Pi(5') Oili dx, to simultaneously find the first variable in the range 
(xi,^! + dxi), the second in the range (x2,X2 + dx2), etc.] Only one of the Xj changes 
value during a single time step. Thus to find Pt+i{S) from Pt{S), one must integrate 
over the region of phase space in which each of the Xi is the smallest and replace it with 
a value drawn from p{x), i.e. 

Pt+l{S) =Y.P{X,) P,(5«)dx: (1) 

.• 1 J ~oo 



i=l 



where the M ^^ M function nii is defined by 

rui = minjxj} (2) 

and S^^^ is shorthand for {xi, . . . , Xj_i, x^, Xj+i, . . . , xn}- The factor of p(xi) on the right 
hand side of (0) can be removed by making the change of variables Ui = J^l^p{z)dz, 
< Mj < 1, giving 

Qt+i{S) = Y. g*(sW)d< (3) 

where Qt Dili d-Uj = Pt Dili dx, . S, S^^^ and m^ are here defined exactly as in (|I|) and 
(0), except with the Xj replaced by Ui . Scaling p{x) out of the master equation in this 
manner reflects that, as in any extremally driven model, the djTiamics depends only on 
the order of the x, and not their relative spacings (note that there is no need to invoke 
universality to prove this result). 

Before proceeding to solve the master equation (|]), it is useful to state and prove 
the following identities. Firstly, 



/ m . dui = 
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(4) 

: ?' ^ 7 
t + 1 



Long-term memory from extremal driving 4 

The i = j case is trivial (since ruj is independent of Uj), whereas for i ^ j observe that 
nij = Ui over the entire range of integration, from which the resuh follows. Another 
useful identity is 



m]dV 



(iV-l)!(t + l)! 
{N + t)\ 

{N-l)\t\ 
{N + t)\ 



(5) 



where Vi is the domain of space in which m, is the smallest, and dV = Y[k=i d^fc • This 
can be proven by considering in turn each of the {N — 1)! subregions of Vi defined by 
Ui < ui-i^ < U12 < . . . < uij^_^, where h ^ i Vfc. For each permutation of the Ik , the 
integral limits for each of the du can be inserted and the integration evaluated. The 
final result (^ then follows from summing over all the possible permutations. 

The rescaled master equation (^) can be solved inductively from the initial state 
Qo = 1 by using the first identity (^), giving 

«,5, ^ (il±^ I .. . (a) 

That this is correctly normalised can be checked using the second identity (|5|). Since Qt 
is symmetric in the nii and therefore the Ui , the probability that any particular element 
in the system, say Uk , is the smallest at a given time tw is just 1/A^. However, suppose 
it is known that Uk is not the smallest at tw • Then Qt„+i can then be found by setting 
Qt„ to zero in Vk , renormalising, and iterating (|^) once. This three-step procedure can 
be repeated to find the following expression for Qt„+tty,iS)^ defined as the probability 
to find the system in a state S* at a time t„ + 1 given that Uk was not the minimum at 
any of the times t^,t„ + 1, . . . ,t^ + t — 1, 

QU*„(5) = ]^('^^^^^'"')E-^"* , ^>1- (7) 

The corresponding probability that Uk is the smallest, denoted here by Qt^+tt^y can be 
calculated by integrating (0) over Vk and using (||), 

1 

which is independent of k. This demonstrates that the probability of an element being 
renewed decreases with the time since it was last renewed, according to qt^+t.t^ ~ i~^ . 
Note that Qt^^t t^ ^Iso decreases with t^ • 

We are now in a position to calculate the physical quantities of interest, starting 
with the persistence R{t) [TT|, |T^. R{t) is defined as the probability that a randomly 
chosen element i has the same value of Xj at time t that it had at t = 0. Clearly, 
i?(0) = 1 and -R(l) = {N — 1)/N. For t > 2, observe that R{t) only decreases when an 
element is renewed for the first time, so R(t + 1) = (1 — gfp) R{t) and hence from (|]), 
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t-i 



Rit) = Rii) n (i - <o) (9) 

(10) 



A^ + t-1 
t 



N-1 



'111 



which defines the persistence exponent 6 = 1. The slow decay of R{t) shows that a 
significant proportion of the system will remain in its initial state until arbitrarily late 
times, already suggesting some form of long-term memory. Note that there is no cut-off 
for finite system sizes; R{t) asymptotically decays algebraically even for N = 2, as long 
as one averages over all possible initial conditions and histories. 

The existence of aging can be most clearly expressed in terms of the two-time 
correlation function C(t„ + 1, t^) between the state of the system at times t^ and t^ + 1. 
A suitable C{t„ + t, tw) for this model is the probability that a randomly chosen element 
has the same value of Xi at t^ and t„ -|- t [so C{t, 0) = R(t)]- As before, C(t^, t„) = 1, 
C{t„ + l,t„) = {N - 1)/N and 

C{t^ + t, t„) = C(t„ + 1, t„) n (l - <u?) (12) 

s=iw+l 

N -I f N + t^ 



N \N + t^ + t-l 
After a short transient this scales as 



) 



t>l. (13) 



C^(iw + t,t„)^^(l + £)"' , |»1. (14) 

That t and tw only appear in the ratio t/t^ is what we mean by aging. Finally, note that 
in the limit N -^ oo, the A^-dependence of ( p!0D and (0) can be removed by renormalising 
the timescale to r = t/N, giving R{t) = (l+r)^^ and C{t^+t, r„) = (r^+l)/(r„+r+l), 
respectively. 

We have now achieved what we set out to do, i.e. demonstrate that even the 
simplest extremally driven model has long-term memory, as evident from the aging 
of C(tw -|- t,tw) in (p!^, and the slow decay of R{t) (0). From this we infer that 
the extremally driven renewal is responsible for the aging observed in [^ H, ^ and 
speculate that other extremal models, such as invasion percolation, may also age in a 
similar fashion. However, it should be stressed that not all extremally driven models 
will necessarily exhibit aging. Indeed, it is already known that including noise-like 
terms, by renewing randomly selected elements as well as the extremal one, introduces 
an exponential cut-off to the relaxation times and destroys the long-term memory 
(this situation is realised in the mean-field version of the Bak-Sneppen model, for 
instance [T^). Thus a useful step forward from this work might be to consider modified 
versions of the model, to see what physical processes may enhance or disrupt the 
effects of extremal driving. To this end, we tentatively suggest that the following 
modifications might be particularly worthy of investigation: introducing quenched 
disorder [by assigning each element its own generating distribution Pi{xi)], allowing the 
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values of Xj before and after renewal to be correlated, and letting the time step between 
updates to depend on the Xi . It is especially hoped that these and other enhancements 
could be treated within the exact framework developed here. 

In summary, we have argued that systems which are renewed according to an 
extremal criterion should be expected to exhibit long-term memory, and have supported 
this claim by showing that even the minimal extremally driven model ages. Expressions 
were found for the persistence R(t) and the two-time correlation function C(t^ + 1, t„) 
which corroborate these claims. Finally, we note that this work also constitutes an 
instance where the extremal properties of a system of correlated random variables can 
be exactly computed. To our knowledge, this makes it one of few such systems known 

MMM- 



Acknowledgements 

This work was funded under UK EPSRC grant no. GR/M09674. 



References 

[1 

[2 



[3] 
[4] 
[5] 
[6] 

[7 
[8 
[9 

[lo: 
[11 

[12 
[13 
[14 
[15 
[16 



Bouchaud J-P, Cugliandolo L F , Kurchan J and Mezard M 1998 Spin glasses and random fields 

ed Young A P (Singapore: World Scientific) 
Bouchaud J-P 2000 Soft and fragile matter: N on- equilibrium dynamics, metastability and flow ed 

Gates M E and Evans M R (Bristol: lOP Publishing and Edinburgh: SUSSP Pubhcations) 
CugHandolo L F and Kurchan J 1993 Phys. Rev. Lett. 71 173 
Wilkinson D and Willemsen J F 1983 J. Phys. A 16 3365 
Bak P and Sneppen K 1993 Phys. Rev. Lett. 71 4083 

Torok J, Krishnamurthy S, Kertesz J and Roux S 2000 Phys. Rev. Lett. 84 3851 
Paczuski M, Maslov S and Bak P 1996 Phys. Rev. E 53 414 
Boettcher S and Paczuski M 1997 Phys. Rev. Lett. 79 889 
Boettcher S 1997 Phys. Rev. E 56 6466 
Bouchaud J-P and Mezard M 1997 /. Phys. A 30 7997 
Derrida B, Bray A J and Godreche C 1994 J. Phys. A 27 L357 
Bray A J, Derrida B and Godreche C 1994 Europhys. Lett. 27 175 
Head D A 2000 J. Phys. A 33 465 



Majumdar S N and Krapivsky P L 2000 unpubhshed l \cond-mat/000623d^ 
Gunibel E J 1958 Statistics of extremes (New York: Golumbia University Press) 
Callisto E 1988 Extreme value theory in engineering (San Diego: Academic Press) 



